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(57) Abstract 

This invention relates to a system and method for interactive, adaptive and individualized computer assisted instruction. This invention 
includes an »gent (108) for each student (101) which adapts to its student, and provides individualized guidance to the student and controls 
to the augmented computer assisted instructional materials. The instructional materials of this invention are augmented to communicate 
the student's performance and the material's pedagogical characteristics to the agent, and to receive control from the agent. Preferably, 
the content of the communication between the agent and the materials conforms to specified interface standards so that the agent acts 
independently of the content of the particular materials. Also preferably, the agent can project using various I/O modalities integrated, 
engaging, life-like display persona(e) appropriate to the preferences of its student, and appear as a virtual tutor to the student. Finally, 
preferably this invention is implemented on computers interconnected by a network. 
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constrained domains, such as a single school system or 
corporate enterprise . 

Existing CAI systems have not addressed these functional 
deficiencies nor have they exploited the possibilities of 
5 existing technologies. 

Citation of references hereinabove shall not be 
construed as an admission that such a reference is prior art 
to the present invention. 

10 3 . SUMMARY OF THE INVENTION 

The Agent Based Instruction ( "ABI " ) system of this 
invention is a system and method for interactive, adaptive, 
and individualized computer-assisted instruction and 
homework, preferably implemented on network connected 

15 computers, that overcomes these problems by providing the 
following objects in preferred and alternative embodiments. 
This invention provides a more effective system responsive to 
the needs of several parties interested in education. 

An important object of this invention is to provide the 

20 student with a virtual tutor, by having agent software 

("agent") adapted to each student that offers a high quality 
of individualized student interaction and that manages or 
controls instruction in a manner approximating a real tutor. 
The agent exercises management or control over the computer- 

25 assisted instruction materials and provides information and 
help to the student, both synchronously and asynchronously to 
particular instructional materials. Agent behaviors are 
sensitive to both the educational context and to the history 
of student behavior. 

3 0 In a preferred embodiment of this invention the agent 

integrates data from several sources. From computer-assisted 
instructional materials, it accepts data on the methods of 
instruction adopted by particular materials and on student 
performance in the instruction. From the student, it accepts 

35 direct interactions as well as using the history of previous 
student performance stored in a student data object. From 
the teacher, it accepts data on customization and student 
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Important teacher activities are included in the following 
list. 

1. The teacher initializes and exercises continuing 
control over important data in the student data object, and 

5 in this manner supervises the student's use of the system. 
For example, the teacher controls the access and level of 
tools available to the student and limits the extent to which 
the student can alter agent personae . 

2. The teacher controls the student's use of the ABI 
10 system by assigning, scheduling, and prioritizing the 

student's access to the materials. This is accomplished by 
teacher control over the schedule subtype in the student 
model object. For example, the teacher can schedule tasks 
that must be completed on the ABI system, schedule non- system 
15 tasks, remove tasks or modify their priorities. 

3. The teacher can customize materials available to the 
students . The extent of routine customization includes 
modifying sequencing of instructional lessons, elements, and 
items, choosing the homeworks the student must complete, 

20 specifying the formats of homework assignments having some 
student discretion, such as reports, sending messages to 
students . 

4. The teacher's class management is aided by a 
facility to send messages, reminders, hints, etc. to students 

25 using the ABI system e-mail facilities. 

The system can advantageously assist the teacher in 
homework management. Once the student completes and submits 
a homework assignment, a printed copy can be made for the 
teacher and the student. The homework assignment can be 

30 graded by the ABI system, if answers were provided as part of 
homework material . The teacher can add comments for the 
student, if homework is viewed online by teacher. 

The system can advantageously also provide the teacher 
with summary and detail reports for each student and class. 

3 5 These reports can be immediately available online or printed 
for later review. As known in the art, reports can contain 
both current and cumulative data on instructional progress 
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5.5.2.3, The Scheduler /Calendar Tool 

The schedule/calendar is an important tool and is 
preferably always present. It is accessed when the ABI 
system initiates materials to verify the student is permitted 
5 and scheduled for this material, and also invoked when the 
system terminates materials to schedule new materials. It is 
accessed as a global function by the agent in response to a 
meta-request from the student seeking scheduling assistance. 
Further, it can be directly accessed by the student using the 
10 calendar tool icon appearing on the student desktop. When 
accessed, this tool displays a calendar book to the student, 
viewable in several ways . 

This section describes, first, the schedule/calendar 
data, and second, the schedule/calendar processing. The 
15 schedule/calendar data is a subtype of and contained in the 
student data object. Generally, this data includes the 
following fields for each scheduled student activity: 

Name of scheduled activity and optionally an identifying 
message ; 
20 Activity priority; 

Deadline date and time, or a definition of a perpetual 
activity, which has periodic requirements but no 
completion date; 
Link to material for the activity which in turn can 
25 specify activity completion criteria,- for activity 

of a single student this is typically a particular 
instructional material; for group work activity a 
list of the students for the group and other 
communication information can also be in the 
3 0 calendar entry; 

Activity characteristics, for example whether this was 
entered by the student or teacher and whether this 
is to be marked complete by the student or system; 
Activity status, completion status and submission status 
35 of any required reports. 

This exemplary data, sufficient to define a scheduled 
activity, can alternatively be entered by the teacher or by 
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as contests with rules. 



Each of these forms of group work or 



communication is described in the remainder of this section. 

A first form of group work implemented by communication 
materials is E-mail and newsgroups. These are useful for 
5 teachers to send information to their classes, such as 

schedule and materials changes and to communicate with absent 
students. Teachers can also exchange information with each 
other or obtain help for system and other issues. Students 
can use this form to obtain help and advice, especially from 

10 remote sources, communicate with their teachers, and share 
work or interests with other students. E-mail and newsgroups 
are easily incorporated as previously discussed. Then 
materials data is authored that grants access to these 
functions and generates appropriate agent event messages. 

15 Student linking is another form of group work 

implemented by communication materials. Students in session 
at separate clients can link together for various exemplary 
activities including simply talking with each other by voice 
or text or for joint work on a particular material in which 

20 the students have either similar roles, as in developing a 
document using a word processor, or different roles, as in a 
simulation or game. Another activity of linked students 
includes group activities, in which position of participants 
within a virtual environment determines activity and role 

25 within activity. A final exemplary activity for linking 

student groups is moderated activity, in which participation 
is controlled by a special coordinating task ,that perhaps 
executes on a server system. An example of this latter 
activity is a spelling bee which is described in more detail 

30 subsequently. 

In the preferred embodiment, student linking induces 
the following steps. The first step is identification of 
other students with whom a given student can link. The group 
can be defined by the teacher in the schedule/calendar entry 

35 for this activity, or alternatively, in a communication 
access control particular to this linked work activity. 
Second, links must be established between the students to be 
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5.6.1. 



^hud^ t Data Object 



One student data object is created for each student in 
the ABI system and is the only permanent repository of data 
concerning >that student. The student data comprises fixed 
5 daca defining the student as well as evolving data describing 
;he student's interaction with the system, the latter 
.ncluding current and past performance and data defining the 
agent's view of the student. The student data object is 
stored on the server system and is the source on the server 

10 system for all teacher and administrative reports concerning 
that student. Elements of the student data object are 
fetched to a client system as required once its associated 
student logs on to that client and on that client serves to 
control the agent and provide for agent adaptivity. 

15 Figs. 10A, 10B and 11 illustrate^ the structure and 

operation of the student data object. Figs. 10A and 10B 
conceptually illustrates an exemplary structure for student 
data object 1101. It is an object comprising structured 
student data 1102 and methods 1103 for accessing and updating 

20 the student data. Student data is divided into global data 
1104, materials related data 1105, including tool related 
data 1106, current lesson data 1107, and log data 1108. 
Global data, that is all items meaningful across all ABI 
materials, includes such subtypes as system data, agent 

25 behavior preference data 1109, agent student model data 1110, 
and schedule data 1111. System data includes student 
identifiers, student passwords, access privileges, grade 
levels, class registrations, etc. Agent behavior preference 
data 1109 relates to the multi-modal behaviors generated by 

3 0 the agent and includes student defined preferences for these 
behaviors as well. as a summary of past agent behaviors. 
Student preferences can include options relating to agent 
visual appearance - species, gender, dress, or perhaps, no 
visual appearance - and similar options relating to audio 

3 5 behavior and text production. The summary of past agent 
behaviors is used to aid in the selection of reasonably 
varied future multi -modal behaviors. Agent student model 
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In another alternative embodiment, the student data 
object has data modeling student interests and preferences. 
Such a model enables the agent, for example, to monitor 
school events and suggest those appropriate to the user. 
5 This model also enables the agent to provide rewards tailored 
to individual students, which enhances the system 
reinforcement and adds to perceived agent persona personality 
and to virtual tutor individualization. In- a preferred 
embodiment, this model of student interests can be 
10 implemented simply as a set of approximately 200 categories, 
covering interest in several subdivisions of each school 
subject area, as well as categories related to sports, 
leisure time and other areas of student interest . Interest 
in these categories can be entered in several manners. 
15 'Student use of the encyclopedia tool can be used to determine 
areas of current interest. Interest can be directly entered 
by the student, parent, or teacher. Alternately, student 
interest in materials can inquired for when the materials 
terminate. After an assignment, the student could provide 
20 semiotic feedback by selecting from a row of faces with 
different expressions. Alternately^ the student can be 
quizzed on interests in a posed branching manner. 

6 . SPECIFIC EMBODIMENTS, CITATION OF REFERENCES 

The present invention is not to be limited in scope by 
the specific embodiments described herein. Indeed, various 
modifications of the invention in addition to those described 
herein will become apparent to those skilled in the art from 
the foregoing description and accompanying figures. Such 
modifications are intended to fall within the scope of the 
appended claims . 

Various publications are cited herein, the disclosures 
of which are incorporated by reference in their entireties. 

35 
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WHAT IS CLAIMED IS : 

1. A method of operating an agent based instruction 
5 system for interactive instruction of a student over a 

plurality of instructional sessions, said method comprising: 

(a) presenting interactive instruction to said 
student by executing one or more materials on a computer 
accessed by said student for a current instructional session; 
10 (b) monitoring said interactive instruction of 

said student during said current instructional session; 

(c) storing information responsive to said 
monitoring of said student during said current instructional 
session for use during subsequent instructional sessions; and 
15 (d) outputting information on said computer to 

guide said student in said interactive instruction, said 
output information responsive to said monitoring of said 
student during said current instructional session and to said 
stored, information responsive to said monitoring of said 
20 student during previous instructional sessions; 

whereby said system acts as a virtual tutor adapted 
co said student, said virtual tutor for guiding said 
interactive instruction of said student. 

25 2, The method according, to claim 1 further comprising 

after said step of monitoring a further step of controlling 
said one or more materials, said controlling responsive to 
said monitoring of said student .during said current 
instructional session and to said stored information 

30 responsive to said monitoring of said student during previous 
instructional sessions, and wherein said one or more 
instructional materials are responsive to said controlling,- 
whereby said interactive instruction presented by 
said system is individualized to said student. 

35 

3 . The method according to claim 2 wherein said step 
of monitoring further comprises monitoring pedagogic 
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characteristics of said interactive instruction of said 
student by said one or more materials, and said step of 
controlling further comprises controlling said one or more 
materials in order to present interactive instruction with 
5 said pedagogic characteristics. 

4 . The method according to claim 3 wherein said 
pedagogic characteristics are selected from the group 
comprising time pacing of interactive instruction, new 

10 concept seeding rate, density of examples, and discrimination 
difficulty. 

5. The method according to claim 2 wherein said step 
of monitoring further comprises monitoring according to an 

15 instructional context and an instructional format adopted by 
each of said one or more materials. 

6. The method according to claim 2 further comprising 
before said step of controlling and said step of outputting a 

20 further step of generating at least one action responsive to 
said monitoring of said student during said current 
instructional session and to said stored information 
responsive to said monitoring of said student during previous 
instructional sessions, and wherein said step of controlling 

25 is responsive to said generated action (s) and wherein said 
step of outputting is responsive to said generated action(s). 

7 . The method according to claim 6 wherein said of 
generating step generates action (s) according to one or more 

30 tables of rules. 

8 . The method according to claim 6 wherein said of 
generating step generates action (s) according to one or more 
methods selected from the group of expert systems, neural 

35 networks, Bayesian belief networks, and statistical pattern 
recognition . 
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9 . The method according to claim 1 wherein said step 
of .outputting information further comprises (i) a step of 
selecting an utterance and an affect from one or more 
^utterance tables in a manner responsive to said monitoring of 
5 said student during said current instructional session and to 
said stored information responsive to said monitoring of said 
student during previous instructional sessions, and (ii) a 
step of. selecting a visual display from one or more tables of 
display behaviors in a manner responsive to said utterance, 
10 said affect, and said monitoring and said stored information. 

10. The method according to claim 9 wherein said step 
of monitoring further comprises monitoring pedagogic 

^information describing the pedagogic characteristics of said 
15 ,|tudent , wherein said selected display behavior comprises one 
pr more personae, and wherein said selected visual display is 
further responsive to said pedagogic information,- 

whereby said one or more personae present a life- 
like appearance individualized to said student's cognitive 
2 0 scyle . 

11. The method according to claim l further comprising 
prior to said step of outputting a step of inputting at least 
one request of said student for guidance in said interactive 

25 instruction, and wherein said output information is further 
responsive to said input requests. 

12. The method according to claim 1 wherein said 
computer accessed by. said student is one computer of a 

30 plurality of computers interconnected by a network, and 
wherein said student cai* access any of said plurality of 
computers for an instructional session. 

13 . The method according to claim 1 wherein said output 
5 information further comprises an utterance and wherein the 

step of outputting further comprises a step of selecting said 
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utterance from one or more candidate utterances, and a 
further step of outputting said utterance as text or speech. 

14. The method according to claim 13 wherein said step 
5 cf selecting further comprises selecting said one or more 

. candidate utterance from one or more tables of utterances. 

15 . The method according to claim 14 wherein said one 
or more table of utterances comprise at least 1,000 

10 utterances. 

16 . The method according to claim 13 wherein said one 
or more candidate utterances comprises at least 10 
utterances. 



17 . The method according to claim 1 wherein said 
responsive output information further comprises a display- 
behavior, and wherein the step of outputting further 
comprises a step of selecting said display behavior from one 

20 or more candidate display behaviors, and a further step of 
outputting said display behavior. 

18 . The method according to claim 17 wherein said step 
of selecting further comprises selecting one or more 

25 candidate display behaviors from one or more tables of 
display behaviors. 

19. The method according to claim 18 wherein said one 
or more tables of display behaviors comprise at least 1,000 

30 display behaviors. 

20. The method according to claim 17 wherein said one 
or more candidate display behaviors comprises at least 10 
display behaviors . 



21. The method according to claim 17 wherein said step 
of outputting said selected display behavior comprises 



15 
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outputting one or more modalities selected from the group 
consisting of text, voice, audio, animation, video, and 
Preformatted animated sequences. 

5. 22. The method according to claim 17 wherein said 

..selected display behavior comprises one or more persona. 

23 . The method according to claim 1 wherein said one or 
more materials is a plurality of materials. 

10 

24 . The method according to claim 1 wherein said one or 
more students is a plurality of students. 

25. The method according to claim 1 wherein said step 
15 of monitoring, further comprises monitoring pedagogic 

^information describing the pedagogic characteristics of said 
^student in a manner independent of the subject matters of 
said one or more materials. 

20 26. The method according to claim 1 wherein said step 

of monitoring further comprises monitoring progress and 
performance information describing the progress and 
performance of said student in said interactive instruction 
presented by each of said one or more materials. 

25 

27. The method according to claim 1 wherein said step 
of storing further comprises storing said information 
responsive to said monitoring in one of one or more student 
data objects, each student data" object of said one or more 

30 student data objects being uniquely associated with exactly 
one student of said one or more students . 

28. The method according to claim 1 wherein said one or 
more materials further comprise a material engine and one or 

3 5 more materials data, and wherein said step of presenting 
interactive instruction by executing one or more materials 
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further comprises executing said materials engine which 
references said one or more materials data. 

29. The method according to claim 28 wherein said 
5 materials data further comprise notations, and wherein said 
step of monitoring further comprises said materials engine 
referencing said notations in order to generate monitoring 
information. 

10 30. A method of operating an agent based instruction 

system for interactive instruction of one or more students, 
said method comprising: 

(a) checking the authority of one of said students 
to access said system for interactive instruction by one or 

15 more materials at a computer, said computer being one 
computer of a plurality of computers interconnected by a 
network; 

(b) loading to said computer software and data for 
said interactive instruction,- 

20 (c) executing said one or more materials on said 

computer for presenting interactive instruction to said one 
student; and 

(d) outputting information on said computer to 
guide said student in said interactive instruction, said 
25 output information responsive to performance of said 
interactive instruction of said student. 

31. The method according to claim 30 further comprising 
after said step of loading a further step of monitoring said 
3 0 interactive instruction, said monitoring generating 
monitoring information that monitors said interactive 
instruction of said student, and wherein said step of 
outputting information is responsive to said monitoring 
information ,- 

35 whereby said system acts as a virtual tutor adapted 

to said one student, said virtual tutor for guiding said 
interactive instruction of said student. 



- 126 - 



# 



WO 97/44767 PCT/US97/08687 



32. The method according to claim 31 further comprising 
after said monitoring step a further step of controlling said 
one or more materials to present instruction to said student 
that is responsive to said monitoring information, whereby 

;/5 said interactive instruction presented by said system is 
• individualized to said student. 

33. The method according to claim 32 further comprising 
after said loading step a further step of maintaining a model 

10 of said one student, said maintaining responsive to said 

monitoring information of said student, and wherein the step 
of outputting and the step of controlling -are further 
responsive to said model of said student,, whereby said 
outputting step and said controlling step adapt to said 

15 student thereby individualizing said interactive instruction 

<> of said student . 

34. The method according to claim 30 wherein said one 
or more materials comprise a plurality of materials. 

20 

35. The method according to claim 30 wherein one or 
more of said plurality of computers are configured as one or 
more server computers for holding databases of software and 
data,, and said step of loading further comprises loading 

25 across said network to said computer from said databases. 

36. The method according to claim 35 wherein said 
loading occurs when said software and data is demanded at 
said computer. 

30 

37. The method according to claim 35 further comprising 
caching read-only data on said computer. 

38. The method according to claim 30 wherein said step 
35 of outputting information further comprises outputting 

information in one or more output modalities. 
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39. The method, according to claim 38 where said one or 
more output modalities are one or more output modalities 
selected from the group consisting of text, graphics, speech, 
audio, animation, video, and pref ormatted animated sequences. 

5 

40. The method according to claim 38 wherein said step 
of outputting selects said output modalities to output one or 
more persona or personae responsive to said interactive 
instruction. 

10 

41. The method according to claim 38 wherein said 
output modalities further comprise content, and said step of 
outputting information further comprises a step of loading 
said content to said computer. 

15 

42. A method of operating an agent based instruction 
system for interactive instruction of one or more students 
over a plurality of instructional sessions, said method 
comprising : 

20 (a> presenting interactive instruction to one of 

said students by executing one or more materials on a 
computer accessed by said student for a current instructional 
session,* 

(b) monitoring said interactive instruction of 
25 said student during said current instructional session; 

(c) storing information responsive to said 
monitoring of said student during said current instructional 
session for use during subsequent instructional sessions; 

(d) determining an affect responsive to said 

30 monitoring of said student during said current instructional 
session and to said stored information responsive to said 
monitoring of said student during previous instructional 
sessions,- and 

(e) outputting information on said computer to 
3 5 guide said student in said interactive instruction, said 

output information responsive to said affect, to said 
monitoring of said student during said current instructional 
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session, and to said stored information responsive to said 
monitoring of said student during previous instructional 
sessions, said output information comprising a visual 
display; 

5 whereby said visual display is responsive to said 

. affect and to said interactive instruction in a life-like 
manner . 

43. The method according to claim 42 wherein said step 
10 of monitoring further comprises monitoring pedagogic 

characteristics of said student, and wherein the step of 
determining an affect determines an affect further responsive 
; to said pedagogic characteristics; 

whereby said visual display is responsive in a 
15 life-like manner individualized to said student's cognitive 
-style. 

44. The method according to claim 42 wherein said 
output information further comprises an utterance, and 

20. .wherein . the step of outputting further comprises a step of 
selecting said utterance from one or more tables of 
utterances in a manner responsive to said monitoring and to 
said stored information, and a further step of outputting 
said utterance as text or speech; 

25 whereby said utterance and said visual display are 

responsive in a life-like manner. 

45. The method according to claim 42 wherein said step 
of outputting further comprises selecting said visual display 

3 0 from one or more tables of visual displays in a manner 

responsive to said affect, to said monitoring, and to said 
stored information . 

46. The method according to claim 42 wherein said 
35 selected display behavior comprises one or more persona. 
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47. An agent based instruction system for interactive 
instruction of one or more students, said system comprising: 

(a) one or more computers having interactive 
input /output devices and interconnected by a network; 
5 (b) one or more materials executable on said one 

or more computers, each said material for presenting 
interactive instruction to said one or more students and for 
generating monitoring information that monitors said 
interactive instruction; and 
10 <c) one or more agents executable on said one or 

more computers, each said agent associated with exactly one 
of said students and each said student associated with 
exactly one of said agents, each said agent comprising 

(i) action processing for controlling said 
15 one or more materials to instruct said associated student, 

said controlling being responsive to said monitoring 
information that monitors said interactive instruction of 
said associated student, and 

(ii) behavior processing for outputting 

20 information to guide said associated student, said outputting 
being responsive to said monitoring information that monitors 
said interactive instruction of said associated student; 

whereby said system acts as a virtual tutor to each 
of said students and said interactive instruction of each of 

25 said students is individualized to each student. 

48. The system according to claim 47 further comprising 
executive software for interfacing said one or more materials 
and said one or more agents to said one or more computers and 

30 to said network. 

49. The system according to claim 47 wherein said 
network is configured to permit any one of said students to 
access any one of said one or more materials from any one of 

35 said computers. 
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50. The system according to claim 47 wherein said 
network is configured to permit one or more of said computers 
to be located in one or more locations. 



■more of said locations are residences of one or more of said 
- students . 

52. The system according to claim 50 wherein one or 
10 more of said materials presents homework to one or more of- 

said students. ... _. . .. . ^ _ r . . _ : ... 

53. The system according to claim 47 wherein said 
network is further configured to be a packet switched 

lS^.necwork . 

54. The system according to claim 47 wherein said agent 
action processing is further responsive to a request for 
guidance from said associated student, and wherein said agent 

20 behavior processing is further responsive to said request for 
guidance . 

55 . The system according to claim 54 wherein said agent 
behavior processing further comprises (i) utterance 

25 generation processing for selecting an utterance and an 

affect responsive to said monitoring information or to said 
request for guidance, and (ii) visual display generation for 
selecting a visual display responsive to said utterance and 
said affect . 



56 . The system according to claim 55 wherein said agent 
behavior processing selects said utterance and said visual 
display to represent a persona, said selection being from a 
table of available personas and according to the preferences 
35 of said associated student. 



51. The system according to claim, 50 wherein one or 



30 
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57. The system according to claim 47 wherein said 
materials further comprise instructional materials executable 
on said computers for interactive instruction of said 
students, and tools executable on said computers for 

5 assistance of said students in said interactive instruction. 

58 . The system according to claim 57 wherein said 
instructional materials further comprise instructional 
materials appropriate to primary or secondary education. 



59. The system according to claim 57 wherein said tools 
further comprise one or more tools selected from the group 
comprising a calculator, a dictionary, a thesaurus, an atlas, 
an encyclopedia, and a network search tool. 



60. The system according to claim 57 wherein said tools 
further comprise a starfish tool for displaying and selecting 
relationships. 



one or more schedule/calendar tools executable on said 
computers, each said schedule/calendar tool associated with 
exactly one of said plurality of students and each said 
student associated with exactly one of said schedule/calendar 
25 tools, each said schedule/calendar tools for outputting to 
said associated student information relating to scheduled 
activities of said associated student, and for providing to 
said agent of said associated student information relating to 
scheduled activities of said associated student. 



62. The system according to claim 61 further comprising 
data areas for each of said students characterizing scheduled 
activities according to deadline date and priority, and 
wherein said schedule/calendar tool further limits said 
35 associated student to interactive instruction according to 
said data areas characterizing said scheduled activities. 



10 



15 



20 



61. The system according to claim 47 further comprising 
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63. The system according to claim 47 further comprising 
one or more communication tools executable on said computers 
for providing forms of interactive group instruction to a 

^ group of said students, and for generating monitoring 
»-5 information that monitors said group instruction of each 
student in said group . 

64. The system according to claim 63 where said forms 
of group instruction are selected from the group consisting 

10 of exchange of messages, group work on a shared material, and 
group participation in educational contests. 



65. The system according to claim 47 wherein one or 
_ more of said materials further comprises materials engine 
15 software and materials data, and wherein said materials 
engine process said materials data to present said 
^.interactive instruction. 



66 . The system according to claim 65 wherein each of 
20 said materials data further comprises: 

(a) a plurality of display objects for 
presentation; 

(b) sequencing logic for controlling the order of 
said presentation of said plurality of display objects; and 

25 (c) notations for causing generation of said 

monitoring information. 

67. The system according to claim 47 wherein one or 
more of said materials comprises a program having data and 

30 instructions. 

68. The system according to claim 47 further comprising 
pedagogic information data areas for each student, said 
pedagogic information data areas comprising data for a 

35 pedagogic model of said student, and wherein said agent 
action processing and said agent behavior processing is 
further responsive to said pedagogic information data areas. 
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69. The system according to claim 68 wherein said data 
in said pedagogic information data areas does not depend on 
the subject matter of said one or more materials. 

5 70. The system according to claim 6 8 wherein said agent 

action processing updates said pedagogic information data 
areas associated with said agent's associated student, said 
updating being responsive to said monitoring information, 
whereby said associated agent adapts to said student . 

10 

71. The system according to claim 68 further comprising 
progress and performance data areas for each student, said 
progress and performance data areas comprising data 
describing progress and performance of each said student in 
15 said interactive instruction, and wherein said agent action 
processing and said agent behavior processing are further 
responsive to said progress and performance information data 
areas . 



20 72. The system according to claim 71 wherein said agent 

action processing updates said progress and performance data 
areas associated with said associated student of said agent, 
said updating responsive to said monitoring information,- 
whereby said associated agent adapts to said 

25 student. 

73. The system according to claim 47 wherein one or 
more of said materials presents said interactive instruction 
according to an education paradigm, and wherein said 

30 monitoring information generated by said materials further 
comprises pedagogic information classified according to said 
education paradigm of said materials. 

74. The system according to claim 73 further comprising 
35 control parameters for each material that have an educational 

paradigm, wherein each material presents said interactive 
instruction according to values of said control parameters, 
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and wherein said agent action processing assigns said values 
of said control parameters; 

whereby said agent action processing controls said 

materials. 

5 

75 . The system according to claim 73 wherein said 

i educational paradigm is selected from the group consisting of 
interactive tutorial, fluency exercise, paired association 
exercise, discrimination formation exercise, and simulation 
10 exercise. 

76 . The system according to claim 73 wherein said 
- educational paradigm is standardized according to an 

# instructional context and an instructional format, : - 
15 

77. The system according to claim 76 wherein said 
instructional context is selected 1 from the group consisting 
of prerequisite test, prerequisite review, pretest, new 
material introduction, new material discrimination, new 

20 material review, fluency exercise practice, review practice, 
and unit mastery test. 

78. The system according to claim 76 wherein said 
instructional format is selected from the group consisting of 

25 multiple choice, unprompted f ill - in- the-blank , fill-in-the- 
blank selected from a list, paired associates by letter, 
paired associates by dragging, paired associates by matching, 
computation, simulation to identify parts of figures or text, 
and simulation game. 

30 

79. The system according to claim 47 wherein said agent 
action processing generates at least one action responsive to 
said monitoring information. 

35 80. The system according to claim 79 .wherein said agent 

action processing further comprises software using one or 
more techniques selected from the group of expert systems, 
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neural networks, Bayesian belief networks, and statistical 
pattern recognition . 

81. The system according to claim 79 further comprising 
5 a plurality of tables of rules, and wherein said agent action 
processing software further comprises software referencing - 
said plurality of tables of rules in order to control said 
one or more materials and to generate said action (s) . 

10 82. The system according to claim 81 wherein said 

plurality of tables of rules comprises a policy filter table, 
a decision weight table, and a selection criteria table, and 
wherein said agent action processing references said policy 
filter table for determining one or more candidate actions, 

15 references said decision weight table for ranking said one or 
more candidate actions, and references said selection 
criteria table for selecting said action (s) from said ranked 
candidate actions. 

20 83. The system according to claim 79 wherein said agent 

behavior processing is responsive to said action (s) in order 
to output information responsive to said monitoring 
information . 

25 84. The system according to claim 83 further comprising 

a plurality of tables of possible outputs, and wherein said 
agent behavior processing software references said tables of 
possible outputs. 

30 85. The system according to claim 84 wherein said one 

or more tables of possible outputs further comprise an 
utterance template table and a display behavior table, and 
wherein said agent behavior processing references said 
utterance template table for selecting an utterance and an 

35 affect according to said action(s), and references said 
display behavior table for selecting a visual display 
according to said action (s), said utterance, and said affect. 
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86. The system according to claim 83 wherein said agent 
behavior processing outputs information in a plurality of 
output modalities . 

5-. ; . 87. The system according to claim 83 wherein said 

^output modalities are one or more output modalities selected 
..from the group consisting of text, graphics, speech, audio, 
animation, video/ and pref ormatted animated sequences. 

10 88. The system according to claim 47 further comprising 

one or more student data objects, each of said student data 
objects associated with exactly one student, and wherein each 
agent stores information reflecting said monitoring 
-information of said one student associated with said agent in 
lS^said one student data object associated with said associated 
-student . 

89. The system according to claim 88 wherein said 
student data object associated with one student further 

20 comprises : 

(a) pedagogic information describing a pedagogic 
model of said one student; and 

(b) progress and performance information for 
describing the progress and performance of said student in 

25 said materials. 

90. The system according to claim 89. wherein said agent 
associated with each student further comprises agent software 
and said student data object associated with said student, 

30 and wherein said agent software references and updates said 
associated student data object. 

91. The system according to claim 47 wherein one or 
more of said computers are configured as server systems, 

35 wherein said server systems store said one or more materials 
and one or more agents, and wherein said one or more 
computers downloads said materials and said one or more 
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agents from said one or more server systems across said 
computer network. 

92. The system according to claim 91 further comprising 
5 databases of pedagogic information and materials progress and 

performance information for said one or more students, and 
wherein said databases are stored on said server systems. 

93. The system according to claim 92 further comprising 
10 reporting software for generating reports from said databases 

of pedagogic information and materials progress and 
performance information for said one or more students. 

94. The system according to claim 47 further comprising 
15 one or more system managers executable on said one or more 

computers, wherein said interactive input /output devices 
include a computer display at each of said one or more 
computers, and wherein said system manager executing on one 
computer partitions said display of said one computer into 
20 one or more display areas. 

95. The system according to claim 94 wherein said one 
or more display areas are selected from the group comprising 
an agent area for agent interactivity, a materials area for 

25 materials interactivity, and a system area in which said 

system manager displays selection icons for available system 
tools and facilities. 

96 . The system according to claim 95 wherein said one 
30 or more materials and said one or more agents provide 

facilities always available to said one or more students and 
said materials area and said agent area comprise sub-areas 
whose selection activates one of said always available 
facilities . 

35 

97. The system according to claim 95 wherein said one 
or more display areas change in size from time to time. 
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98. The system according to claim 47 wherein one or 
more teachers directs instruction of one or more of . said 
students, said system further comprising: 

(a) one or more teacher materials executable on 
5„ said one or more computers, each said teacher material for 
presenting interactive instruction to teachers in the use of 
^said system and in the use of materials directed to said 
students and for generating monitoring information that 
monitors said interactive instruction; and 
10 , (b) one or more teacher agents executable on said 

one or more computers, each said teacher agent associated 
with exactly one of said teachers and each said teacher 
associated with exactly one of said agents, each said agent 
„. comprising 

15 r <i) action processing for controlling said 

^one or more materials to instruct said associated teacher, 
ri said controlling being responsive to said monitoring 
information that monitors said interactive instruction of 
said associated teacher, and 
20 (ii) behavior processing for outputting 

information to guide said associated teacher, said outputting 
being responsive to said monitoring information that monitors 
said interactive instruction of said associated teacher . 

25 99 . An agent based instruction system for interactive 

instruction of one or more students, said system comprising: 

(a) one or more computers having interactive 
input/output devices and interconnected by a network; 

(b) one or more materials executable on said one 
30 or more computers, each said material for presenting 

interactive instruction to said one or more students and for 
generating monitoring information that monitors said 
interactive instruction; and 

(c) one or more agents executable on said one or 
35 more computers, each said agent associated with exactly one 

of said students and each said student associated with 
exactly one or said agents, each said agent comprising 
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(i) utterance generation processing for 
selecting an affect and an utterance to guide said one 
associated student, said selecting of said affect and said 
utterance being responsive to said monitoring information 
5 that monitors said interactive instruction of said one 
associated student, and 

(ii) visual display generation for selecting a 
visual display to guide said one associated student, said 
selecting of said visual display being responsive to said 
10 affect, to said utterance, and to said monitoring information 
that monitors said interactive instruction of said associated 
student, and 

(iii) output processing for outputting to said 
associated student said selected utterance and said selected 
15 visual display ; 

whereby said selected visual display and said 
selected utterance are responsive to said affect and to said 
interactive instruction in a life-like manner. 

20 100 . The system according to claim 99 wherein said 

monitoring information further comprises pedagogic 
information describing the pedagogic characteristics of 
associated student, and wherein utterance generation 
processing selects an affect further responsive to said 

25 pedagogic information,- 

whereby said selected visual display and said 
selected utterance are further responsive in a manner 
individualized to a cognitive style of said associated 
student . 

30 

101. The system according to claim 99 wherein said 
utterance generation processing selects said affect and 
utterance from one or more tables of utterances. 

35 102. The system according to claim 99 wherein said 

visual display processing selects said visual display from 
one or more tables of visual displays . 



said 



said 



140 - 




WO 97/44767 PCT/US97/08687 



103. The system according to claim 99 wherein said 
selected visual display comprises one or more persona. 

104. The system according to claim 99 further comprising 
5- action processing for generating at least one action and for 

■controlling said one or more materials to instruct said 
^ associated student, said generating and s a id .:, cpnpxp Hi ng 
being responsive to said- monitoring 1 information that monitors 
said interactive instruction of said associated student, and 
10 wherein said utterance generation processing and said visual 
display selection processing are further responsive to said 
action (s) . 

■ ? 105. A method of operating an agent based instruction. 

15 -system for instruction of a plurality of students, said 
;^ method comprising: 

■;M (a) executing one or more materials on a computer 

for presenting interactive instruction to one student of said 
plurality of students, said computer being one computer of a 
20 plurality of computers interconnected by a network, each 
computer of said plurality having interactive input /output 
devices; 

(b) generating monitoring information that ' 
monitors said interactive instruction presented to said 

25 student; and 

(c) controlling said one or more materials to 
instruct said student, said controlling being responsive to 
said information monitoring the interactive instruction of 
said student; 

30 whereby said interactive instruction is 

individualized to each student of said plurality of students. 

106. The method according to claim 105 further 
comprising after said seep of generating a further step of 
35 outputting information on said computer to. guide said student 
in said interactive instruction, said outputting information 
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responsive to said monitoring information of said interactive 
instruction of said student; 

whereby said system acts as a virtual tutor adapted 
to said student, said virtual tutor for guiding said 
5 interactive instruction of said student. 

107. The method according to claim ? wherein said output 
information further comprises one or more persona. 

10 108. The method according to claim ? wherein said step 

of outputting information further comprises outputtihg 
information in a plurality of output modalities. 

109. The method according to claim 108 wherein said 

15 output modalities are one or more output modalities selected 
from the group consisting of text, graphics, speech, audio, 
animation, video, and preformatted animated sequences 

110 . The method according to claim ? wherein said step 
20 of outputting information further comprises (i) a step of 

selecting an utterance and an affect from one or more 
utterance tables in a manner responsive to said controlling 
step and (ii) a step of selecting a visual display from one 
or more tables of display behaviors in a manner responsive to 
25 said utterance, said affect, and said controlling step. 

111. The method according to claim ? further comprising 
prior to said outputting step a further step of inputting 
student requests for guidance in said interactive 

30 instruction, and wherein said step of outputting information 
is further responsive to said student requests. 

112. The method according to claim 105 wherein said one 
or more materials is a plurality of materials. 

35 

113. The method according to claim 105 further 
comprising prior to said executing step a further step of 
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accessing any one of said computers by said one student, said 
accessing comprising verifying the authority of said one 
student to access said system for interactive instruction by 
?f; said one or more materials. 



114. The method according to claim 113 wherein one or 
more of said computers are located in a plurality of 
locations, and wherein the step of accessing further 
comprises accessing any of said computers in plurality of 

10 locations. j 

115. The method according to claim 114 wherein one or 
more of said plurality of locations are residences of one or 
more of said students, and wherein said one or more materials 

lS^presents homework in said one or more residences. 

'fi' 116. The method according to claim 105 wherein said step 

of controlling further comprises controlling according to one 
or more tables of rules. 



117. The method according to claim 116 wherein said one 
or more tables of rules further comprise a policy filter 
table, a decision weight table, and a selection criteria 
table, and wherein said controlling step controls said one or 

25 more materials according to one or more determined 

controlling actions, and wherein said controlling step 
references said policy filter table for determining one or 
more candidate controlling actions, references said decision 
weight table for ranking said one or more candidate 

30 controlling actions, and references said selection criteria 
table for selecting one or more controlling actions from said 
ranked candidate controlling actions. 

118. The method according to claim 105 wherein said step 
35 of controlling further comprises controlling according to one 

or more methods selected from the group consisting of expert 
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systems, neural networks, Bayesian belief networks, and 
statistical pattern recognition. 



119. The method according to claim 105 wherein the step 
5 of executing further comprises executing one or more of said 

one or more materials according to an educational paradigm, 
and wherein said monitoring information further comprises 
pedagogic information classified according to said 
educational paradigm adopted by said one or more materials. 

10 

120. The method according to claim 119 wherein said 
educational paradigm is standardized according to an 
instructional context and an instructional format. 

15 121. The method according to claim 105 further 

comprising after said generating step a further step of 
updating one student model of a plurality of student models, 
each student of said plurality of students being associated 
with exactly one student model, said updating being 

20 responsive to the information monitoring the interactive 
instruction of said student, and wherein the step of 
controlling said one or more materials to instruct said 
student is further responsive to said student model of said 
student; 

25 whereby said one or more materials are 

individualized to said student. 

122. The method according to claim 121 wherein said step 
of updating further comprises updating pedagogic information 
30 in said student model, said pedagogic information describes 
pedagogic characteristics of said student of said plurality 
of students in a manner independent of the subject matters of 
said one or more materials. 



35 123. The method according to claim 121 wherein said step 

of updating further comprises updating progress and 
performance information in said student model, said progress 
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and performance information describes the progress and 
performance of said student in said interactive instruction 
presented by each of said one or more materials. 

5., 124. The me: nod according to claim 105 wherein said one 

or more materials further comprises one or more instructional 
r materials for presenting interactive instruction to said 
plurality of students, and one or more tools for presenting 
interactive assistance to said plurality of students during 
10 said interactive instruction. 

125. The method according to claim 105 further 
comprising prior to said controlling step (i) a step of 
executing one scheduler/calendar tools of a plurality of 

15 r scheduler/calendar tools, each student of said plurality of 
( , students being associated with exactly one scheduler/calendar 
„ tool, said one scheduler/calendar tool providing said student 
with information relating to scheduled activities of said 
student, and (ii) a step of generating monitoring information 
20 that monitors said scheduled activities of said student. 

126. The method according to claim 125 wherein the step 
of executing executes one or more materials that relate to 
said scheduled activities of said student. 

25 

127. The method according to claim 105 further 
comprising prior to said controlling step (i) a step of 
executing one or more communication tools for presenting one 
or more forms of group instruction to a group of students, 

30 said group including said student, and (ii) a step of 

generating monitoring information that monitors said group 
instruction of said student. 

128. A method of operating an agent based instruction 
35 system for instruction of a plurality of students, said 

method comprising: 
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(a) a step for executing one or more materials on 
a computer for presenting interactive instruction to each 
student, said computer being one computer of a plurality of 
computers interconnected by a network, each computer of said 

5 plurality having interactive input/output devices; 

(b) a step for generating monitoring information 
that monitors said interactive instruction presented to each 
student of said plurality of students; 

(c) a step for controlling said one or more 

10 materials to instruct each student, said controlling being 
responsive to said information monitoring the interactive 
instruction of each student; and 

(d) a step of outputting information to each 
student in order to guide each student in said interactive 

15 instruction, said outputting step responsive to said 

information monitoring the interactive instruction of each 
student and responsive to said controlling step; 

whereby said interactive instruction is 
individualized to each student of said plurality of students 

20 and acts as a virtual tutor individualized to each student. 

129. An agent based instruction system for instruction 
of a plurality of students, said system comprising: 

(a) means for presenting interactive instruction 
25 to each student by one or more materials; 

(b) means for generating monitoring information 
that monitors said interactive instruction presented to each 
student ; 

(c) means for controlling said one or more 

30 materials to instruct each student, said controlling being 
responsive to said information monitoring the interactive 
instruction of each student; and 

(d) means for outputting information to each 
student in order to guide each student in said interactive 

35 instruction, said means for outputting being responsive to 
said information monitoring the interactive instruction of 
each student and responsive to said means for controlling; 
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whereby said interactive instruction is 
individualized to each student and said acts as a virtual 
tutor individualized to each student. 

5 " 130. An agent based instruction system for instruction 
of a student, said system comprising: 

:^ (a) one or more materials executable on a computer 

for ■ presenting interactive instruction to said student, said 
computer having interactive input /output devices; and 

10 (b) an agent executable on said computer, said 

agent (i) receiving monitoring information from each of said 
one or more materials that monitors said interactive 
instruction of said student, (ii) controlling said one or 
more materials to instruct said student, said controlling; 

15 being responsive to said monitoring information, and (iii) 

outputting information to guide said student, said outputting 
bering responsive to said monitoring information. 

131. A system for agent-based, interactive instruction 
20 of one or more students over a plurality of instructional 
sessions, said system comprising: 

(a) means for presenting interactive instruction 
to one of said students by executing one or more materials on 
a computer accessed by said student for a current 

25 instructional session; 

(b) means for monitoring said interactive 
instruction of said student during said current instructional 
session; 

(c) means for storing information responsive to 
30 said monitoring of said student during said current 

instructional session for use during subsequent instructional 
sessions,* and 

(d) means for outputting information on said 
computer to guide said student in said interactive 

35 instruction, said output information responsive to said 

monitoring of said student during said current instructional 
session and to said stored information responsive to said 
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monitoring of said student during previous instructional 
sessions ,- 

whereby said system acts as a virtual tutor adapted 
to said student, said virtual tutor for guiding said 
5 interactive instruction of said student. 

132. A system for agent-based, interactive instruction 
of one or more students over a plurality of instructional 
sessions, said system comprising: 
10 (a) means for presenting interactive instruction 

to one of said students by executing one or more materials on 
a computer accessed by said student for a current 
instructional session ,* 

(b) means for monitoring said interactive 

15 instruction of- said student during said current instructional 
session; 

(c) means for storing information responsive to 
said monitoring of said student during said current 
instructional session for use during subsequent instructional 

20 sessions ; ■ 

(d) means for determining an affect responsive to 
said monitoring of said student during said current 
instructional session and to said stored information 
responsive to said monitoring of said student during previous 

25 instructional sessions; and 

(e) means for outputting information on said 
computer to guide said student in said interactive 
instruction, said output information responsive to said 
affect, to said monitoring of said student during said 

30 current instructional session, and to said stored information 
responsive to said monitoring of said student during previous 
instructional sessions, said output information comprising a 
visual display; 

whereby said visual display is responsive to said 

35 affect and to said interactive instruction in a life-like 
manner . 
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133. A computer readable medium comprising instructions 
for performing the method of claim 1 . 

r*v 134. A computer readable medium comprising instructions 
5 for performing the method of claim 30. 

t* 135 A computer readable medium comprising instructions 
for performing, the method of claim 42. 
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